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Abstract 

Background: We present a novel method for quantitative analysis of dicot leaf expansion at high temporal 
resolution. Image sequences of growing leaves were assessed using a marker tracking algorithm. An important 
feature of the method is the attachment of dark beads that serve as artificial landmarks to the leaf margin. The 
beads are mechanically constricted to the focal plane of a camera. Leaf expansion is approximated by the increase 
in area of the polygon defined by the centers of mass of the beads surrounding the leaf. Fluctuating illumination 
conditions often pose serious problems for tracking natural structures of a leaf; this problem is circumvented here 
by the use of the beads. 

Results: The new method has been used to assess leaf growth in environmental situations with different 
illumination conditions that are typical in agricultural and biological experiments: Constant illumination via 
fluorescent light tubes in a climate chamber, a mix of natural and artificial illumination in a greenhouse and natural 
illumination of the situation on typical summer days in the field. Typical features of diel (24h) soybean leaf growth 
patterns were revealed in all three conditions, thereby demonstrating the general applicability of the method. 
Algorithms are provided to the entire community interested in using such approaches. 

Conclusions: The implementation Martrack Leaf presented here is a robust method to investigate diel leaf growth 
rhythms both under natural and artificial illumination conditions. It will be beneficial for the further elucidation of 
genotype x environment x management interactions affecting leaf growth processes. 
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Background Overall, circadian regulation has to be assumed necessary 

Plant size and shape is determined by its growth, while to maintain plant productivity [8]. Growth thus can be 

growth itself can be influenced by numerous endogenous, considered as the major, integrating output process of 

genetic, epigenetic and environmental factors. It is well plant metabolism, cumulating over time into final leaf size 

known that leaf growth, many metabolic reactions, physio- [15,16]. Dynamic fluctuations of growth therefore reflect 

logical processes and elements of regulatory networks adjustments of endogenous processes to variations of 

show diel (24 h) fluctuations that are partly controlled by environmental conditions; their elucidation can be of im- 

the circadian clock [1-12]. Light and temperature beside portance to understand processes of biomass and yield 

many other environmental parameters, which can affect formation [17]. 

that circadian rhythm are the most "potent" and import- Therefore, it is of vital importance to monitor diel 

ant input factors of circadian entrainment [1,13,14]. growth patterns as influenced by different environmental 

conditions [2,18-26], development [27] or by alterations 

— , , . , in metabolism [28,29]. Several quantitative methods 
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have been developed and applied to study fluctuations in 
growth of various plant organs such as roots and leaves in 
recent years [13-15,30-32]. Other non-imaging methods for 
measurements of growth, such as "classical auxanometers" 
[33], linear voltage differential transducers (LVDTs) [34,35], 
rotary resistance transducers (RRTs) [2], direct assess- 
ment of plant size or subsequent manual assessment of 
displacement of markings that have been applied to the 
organ surface [36,37], exist and have been used both in 
field and climate chamber experiments. Yet they are 
limited either to measurements of one-dimensional 
growth (elongation), are labor intensive needing manual 
processing steps or do not provide a suitable high tem- 
poral or spatial resolution, as do quantitative methods 
based on image processing, which are thus preferable. 

In general the techniques applied can be classified in 
three groups of image processing approaches [32]: (I) 
"morphometric", (II) "optical flow" and (III) "particle / 
marker tracking" with the two latter methods providing 
the potential for analysis of spatially differentiating growth 
or strain rates within the organ if marker or grey value 
structures within the organ can be followed kinematically. 

Morphometric approaches are based on segmentation 
algorithms calculating projected leaf area and additional 
shape parameters from analysis of the outline of leaves 
or leaf rosettes. High-throughput phenotyping methods 
are typically based on such approaches [38-43]. Even 
though morphometric image processing has been ap- 
plied to estimate the projected area and shape of single 
leaves both in vivo and in studies of harvested leaves 
[44] it has been found most effective in investigations 
on a whole plant/shoot level. For investigation of diel 
growth patterns, morphometric approaches have found 
only limited usage due to problems arising from leaf 
motion [32]. Furthermore it is not possible to extract 
spatial differences in growth rate within the segmented 
plant organs. 

Optical flow based growth estimation is the most 
powerful method to provide both high temporal and 
high spatial resolution. Such methods have been applied 
to study leaf [2,17,45,46], root [47-49] and hypocotyl 
growth [50]. The movement of structural patterns within 
the space-time-cube of subsequent images is used to 
calculate velocity fields of structural elements such as 
vein intersections, trichomes or ink dots applied on the 
leaf surface on a subpixel level of accuracy [51], as long 
as image brightness is constant. Recent improvements 
allowed to study diel growth patterns of small leaves of 
the model species Arabidopsis thaliana, thereby opening 
the possibility to even investigate alterations in growth 
of a wide repertoire of mutant and transgenic plants 
such as starch deficiency, circadian or photorespiratory 
mutants [28,29,52]. Yet, optical flow based approaches 
are sensitive to brightness fluctuations and they require 



that structural patterns are not moving too fast from 
one image to the next. Therefore, even though leaves are 
growing slowly, a huge number of images have to be ac- 
quired within short time, as physical structures are not 
allowed to change position for more than one pixel be- 
tween consecutive images. This inevitably increases the 
size of image sequences. Although computer storage cap- 
acity and processing speed continuously advance, this 
problem should not be underestimated. An image se- 
quence showing expansion of a single leaf throughout 
several days typically needs to comprise several gigabytes 
(one image per minute) to allow for optical flow based 
data evaluation. After all calculation, the amount of data 
typically exceeds 10 gigabytes. With a project typically 
consisting of dozens of sequences that have been acquired 
it is obvious that this leads to challenges in data handling, 
storage, backup and exchange of data even under todays 
norms. The problem becomes even potentiated, if it is ne- 
cessary to increase the spatial resolution, as characteristic- 
ally higher spatial resolution makes it necessary to also 
increase the temporal resolution of image acquisition. A 
second major problem associated with the optical flow 
approaches is the fact that the so-called 'brightness change 
constraint equation' (BCCE) has to be fulfilled throughout 
the sequence, which means, that a constant brightness has 
to be assured [53-56]. Under controlled conditions in cli- 
mate chambers this is possible throughout day and night 
by using infrared diode illumination of the scenery and in- 
frared bandpass filters in front of the camera. Yet, under 
greenhouse conditions and even more in the field, it is 
nearly impossible to fulfill this intensity requirement due 
to diurnal fluctuations in illumination. 

Marker tracking is a technique of image processing 
and analysis, in which a discrete number of landmarks is 
registered initially within the object of interest. The 
position of these featured landmarks is followed in the 
consecutive images of an image sequence using pattern 
matching in the local neighbourhood of these markers. 
Based on this approach, it is possible to calculate rela- 
tive growth rate (RGR) with high temporal resolution 
[57]. Such approaches have been used successfully to 
study root growth [58-60] by following either artificially 
applied particles on the root surface or by taking cell 
walls as markers. In the context of leaf growth though, 
marker-tracking-based image processing routines only 
have been applied in a limited number of studies [61,62]. 
Moreover, in these studies there was no attempt to analyze 
leaf growth at high temporal resolution or to perform field 
experiments. In general, marker tracking is a very power- 
ful and robust method in image processing, in which the 
BCCE requirement does not have to be fulfilled [63]. 
Therefore, it should be possible in principle to assemble a 
marker-tracking based approach that allows assessment of 
diel leaf growth patterns in field experiments. 
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It was the aim of this study to establish a marker-based 
approach that allows monitoring of diel leaf growth fluctu- 
ation in various illumination conditions, revealing typical 
features of diel leaf growth patterns that are known from 
optical flow based approaches, without further consider- 
ation of base-tip gradients or other spatial growth differ- 
ences within the leaf lamina. 

Material and methods 

Growth conditions 

Soybean plants (Glycine max (L.) Merrill, variety "Gallec") 
were grown in plastic pots (10 cm x 10 cm x 10 cm) 
filled with substrate ("Spezialmischung 209", RICOTER 
Erdaufbereitung AG, Aarberg, Switzerland) inside a 
climate chamber (Conviron, Winnipeg, Canada) under 
controlled conditions with a 13h/llh light/dark photo- 
period: light intensity 580 ± 75 umol PAR m" 2 s" 1 ; aver- 
age temperature of 24°C (day) and 20°C (night); relative 
humidity 60% (day and night). The climate chamber was 
equipped with a 2:1 mixtures of fluorescent lamps of two 
types (Master TL5 HO 54W/840, Koninklijke Philips 



Electronics N.V., Eindhoven, the Netherlands and 
FH054W/T5/GRO, Havells Sylvania Europe Ltd, London, 
UK). 

Additional soybean plants (variety "Amphor") were 
grown in a greenhouse and in the field of the research 
station for plant science of ETH Zurich in Lindau- 
Eschikon. Soybean plants in the greenhouse were grown in 
plastic pots as described above, filled with substrate 
("Spezialmischung 209/09-047", RICOTER Erdaufbereitung 
AG, Aarberg, Switzerland). The plants were kept under 
standard greenhouse conditions and were watered on a 
regular basis. In the field, plants were sown in small plots 
(6.5 m length, 1.5 m width, 18 cm row width, 60 seeds/m 2 ). 

Mechanical leaf fixation and preparation of image 
acquisition 

One growing leaf of every investigated plant was fixed in 
the focal plane of a top mounted camera placed above the 
abaxial leaf surface using 5 small weights of 2.5 to 9 g at- 
tached with strings and glue (Pattex @ KRAFTKLEBER 
Classic, Henkel AG & Co. KGaA, Dusseldorf, Germany) 




Figure 1 Setup used in the field. (A) Overview of the soybean field and setup; (B) Setup wrapped in plastic bags due to rain (measurement 
stopped); (C) Close-up view of the setup with infrared camera on top, infrared diodes and a soybean leaf fixed with strings glued to the leaf with 
attached weights; (D) Close-up view of the fixed soybean leaf with attached black beads; (E) Original image of a soybean leaf in the field taken 
with an infrared camera. 

\ ) 
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Figure 2 Setup used in the greenhouse. (A) Camera, infrared 
diodes and a soybean leaf fixed in a metal frame; (B) Close-up view 
of a fixed soybean leaf with attached black beads and threads. 



to the leaf surface (Figures 1 and 2) [2,28,29,49]. Small 
leaves were fixed using small weights; preliminary ex- 
periments showed that the weights did not affect final leaf 
size or shape. Weights were hung over a circular metal 
frame around the leaf. An additional weight was used as 
counterforce attached at the opposite side of the shoot to 
avoid unwanted movements of the plants. Additionally, 
parafilm was used to fix the leaf at its base to a thin metal 
bar in the ring without hurting the plant, thereby assuring 
that stem elongation did not lift parts of the leaf above the 
focal plane of the camera during acquisition of the image 
sequence. Black plastic beads (5 mm diameter) were glued 
to the strings at the leaf border to provide artificial land- 
marks that allowed registration of marker movements, see 
sketch in Figure 3. 

To allow continuous measurement of plant growth 
during night and day, a metal ring with 6 infrared LED 
clusters (940 nm) was used as illumination source (see 
[28,29]). Usage of infrared LEDs has two major advan- 
tages: (1) leaf growth and plant metabolism are not af- 
fected by near-infrared light beyond 800 nm and (2) as 
leaves diffusely reflect more light in the infrared region of 
the spectrum, contrast between leaves and background is 
enhanced while specular reflexes can be avoided. 

Image acquisition 

Monitoring and analysis of growth in greenhouses and 
in the field was performed using a standard progressive 
monochrome CCD camera (XC-55, Sony Corporation, 
Tokyo, Japan) linked to a personal computer (PC). Im- 
ages of the growing leaf were acquired every 90 seconds 
with a resolution of 640 x 480 pixels. The camera was 
equipped with a lens (H1214-M, 12 mm 1:1.2, Pentax 
Ricoh Imaging Co., Ltd, Tokyo, Japan) and a narrow 
bandpass interference infrared filter (940 nm, Edmund 
Optics Ltd, York, UK) to improve overall image quality 
and to allow continuous measurement under artificial 
near-infrared illumination during night and day with 
fixed camera settings. Automatic gain correction (AGC) 
was activated for image acquisition under field condi- 
tions. Image acquisition in the near infrared region of 
the spectrum is generally possible in this setup, as 
standard CCD cameras typically are sensitive up to a 
wavelength of llOOnm if no additional hot-mirror or fil- 
ter is placed inside the camera. Thus, the overall setup 
is highly comparable to that of the so-called 'digital 
image sequence processing (DISP) setup' [30,32] that 
has been used frequently to monitor diel leaf growth 
patterns via an optical flow based algorithm. Image ac- 
quisition in the field was performed on several consecu- 
tive days without rain to avoid any hardware defects. No 
additional shelter was applied. 

Image acquisition in the climate chamber was conducted 
with monochrome CMOS cameras (DMK 23GP031, The 
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Figure 3 Principle sketch of setup. (A) Top view of soybean leaf 
fixed with strings in a metal frame with marker beads attached at 
the leaf margin, the artificial background is shown in gray; (B) Whole 
setup in top side view with camera, infrared LED clusters and fixed 
soybean leaf. 

v J 



Imaging Source Europe GmbH, 28215 Bremen, Germany). 
Each camera was equipped with a lens (C2514-M, 25 mm 
1:1.4, Pentax Ricoh Imaging Co., Ltd, Tokyo, Japan) and a 
narrow bandpass interference infrared filter (940 nm, 
Edmund Optics Ltd, York, UK). The cameras were linked 



via Ethernet cables to a switch (SG300-10P, Cisco Systems 
Inc., San Jose, USA) and this in turn linked to a router 
(Cable/DSL Web Safe Router RP G14 v4, NETGEAR Inc., 
San Jose, USA) and to a PC. Images were acquired every 
90 seconds with a resolution of maximally 2592 x 1944 
pixels and the images were stored directly from the 
software "IC Capture" (The Imaging Source Europe 
GmbH, 28215 Bremen, Germany) to a PC. By using a 
switch, several cameras were operated simultaneously 
with only one PC. Another advantage of these cameras 
was that they were powered over Ethernet so no add- 
itional power supply was needed. 

Algorithm and software for optimized leaf growth 
analysis 

The algorithm for marker tracking was implemented in 
Matlab 7.12 (The Mathworks, Natick, MA, USA). Tem- 
plate sizes of 23 x 23 pixels up to 85 x 85 pixels depend- 
ing on image resolution were tracked in the local 
neighborhood with a search length of 6 pixels and larger. 
These parameters can be freely adjusted using a graph- 
ical user interface. The small black beads attached to the 
leaf margin were used as artificial landmarks and were 
selected by clicking on them in the initial image of the 
image sequence in the graphical user interface (Figure 4). 

Based on the calculated area it is possible to calculate 
relative growth rate (RGR) of the enclosed pentagon for 
every frame of the image sequence by using the follow- 
ing equation (A 2 area at image (frame) number f x ): 

/ rw „ x (lnAo-lnAi) 
RGR (in % per frame) = - - 100 

12-11 

To calculate RGR in percent per hour for every frame, 
a time correction factor f c corresponding to the number 
of images acquired during every hour was applied: 

RGR (in % per hour) = RGR (% per frame) f c 

As images were acquired every 90 seconds, a time cor- 
rection factor of 40 was used throughout the experiment. 

The graphical user interface (GUI) implemented in 
Matlab was kept as simple as possible with processing 
scheme implemented as shown in Figure 4. Initially the 
recorded image sequence is opened and in the first frame 
of the sequence the center of each bead is selected separ- 
ately by mouse-clicks. Afterwards, a template-size around 
the black beads has to be defined. In the following step, a 
search length has to be assigned for the neighborhood in 
which the bead has to be found in consecutively following 
images (frames). The calculation is then started and every 
black bead is tracked throughout the whole sequence. At 
the end of this process, the path of the center of every 
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Figure 4 Analysis of image sequence. (1) Images need to be 
taken. (2) Centre of each black bead must be selected. (3) The 
template size around the black bead has to be chosen. (4) The 
maximum search length of the template must be given. (5) In each 
image the positions of the five black beads are automatically 
tracked. (6) The area of the polygon defined by the positions of the 
5 black beads is computed for each image. (7) Relative growth rate 
is calculated from the increase in area. (For a detailed step by step 
guide on Martrack Leaf consult the manual (see Additional file 1). 



tracked bead throughout the sequence is displayed with a 
red line in the starting image (Figure 5). 

The block matching algorithm determines the best 
position of each template in the current image by nor- 
malized cross-correlation (CC) [63]. 



Xj yesCC(x,y) ■■ 



(i(x + m,y + n) -I xy ) * (t(m,n)-T) 



Where S is the search area, x,y are the upper left coor- 
dinates of the image area which is compared to the tem- 
plate, i is the image. I xy is the mean gray value of the 
image area which is matched to the template t, and T is 
the mean gray value of t. The coordinates within the 
matched image area, both of i and the template t, are 
called m and n. 

Template size and search area are adjustable to the 
image material and temporal sampling of the scene. For 
each template the CC is calculated around the position 
in the last investigated image in the chosen search area. 
The best position is localized by the maximal CC value 




Figure 5 Illustration of the growth of a soybean leaf in a 
climate chamber. The five red lines are overlaid to the first image 
of a sequence. They indicate the path of the center of every single 
black bead tracked over a period of 86.5 hours with Martrack Leaf. 
The green pentagon shows the leaf area at beginning of the 
measurement whereas the yellow pentagon denotes the area at the 
end of the measurement. 
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CC max . If CC max is lower than 0.7 the template is 
regarded as not found, which ensures a high quality of 
template positions. 

Subpixel accuracy of template positions is achieved by 
using a quadratic interpolator for the cross-correlation 
[64]. The maximum of the quadratic polynomial defined 
by CC max and its neighboring CC values in x-direction 
therefore gives the subpixel position in x-direction; the 
subpixel position in y-direction is determined accordingly. 

For each frame, the bead positions define a polygon, 
which approximates the leaf area. The area of the poly- 
gon is calculated with the GauE-formula for trapezes: 

n 

A = 0.5^y i+1 Xi- yi x i+ i 

i=l 

Where A is the polygon area, x,y are the coordinates 
of the n corner points of the polygon. Indices are 
regarded modulo n, which means x n+1 =x L 

Martrack Leaf is provided online compiled for different 
operating systems (for detailed manual see Additional file 
1, linux see Additional file 2, Mac see Additional file 3 
and Windows 64-bit see Additional file 4). In order to 
execute Martrack Leaf, the Matlab Compiler Runtime 
(MCR; Vers. R2012a 64-Bit) (The Mathworks, Natick, 
MA, USA) needs to be installed on the user machine 
(download at http://www.mathworks.com/products/com- 
piler/mcr/). Files with extension .fig are figures in a 
Matlab- specific format, they can be displayed, printed 
and saved using the provided executable showfigure.exe 
(included in the Additional files for each operating 
system). 

Results 

In preliminary experiments, different wooden and plastic 
beads from local crafts stores were tested for their optical 
properties. Most of the black beads tested fulfilled the re- 
quirement to show a low reflectance in the near-infrared 
range. Therefore, it was easy to differentiate beads from 
the leaves and leaf margins. Nevertheless, soil and non- 
soil shadowed backgrounds also often appeared very dark, 
which made it impossible to maintain contrast differences 
between beads and background under many conditions. 

It was therefore beneficial to introduce a bright back- 
ground below the leaf, thereby increasing contrast be- 
tween beads and background (see Figures 1 D+E and 2). 
Experiments performed in climate chambers showed 
clearly oscillating temporal leaf growth patterns (see Fig- 
ure 6) RGR increased during the day, reaching a max- 
imum at day-night-transition. At night, RGR declined 
again. Short-term fluctuations of RGR were present, but 
the overall diel pattern remained constant throughout 
several days. 



In the field, similar diel leaf growth patterns were 
obtained (Figure 7). At noon though, plants grown in 
the field showed a pronounced, transient drop in their 
RGR. Fixation of leaves in the field worked well, and 
movement of leaves was prevented by leaf fixation even 
when relatively strong gusts of wind were present. In a 
period of dry weather, it was therefore possible to moni- 
tor leaf growth on three consecutive days without rain. 
Since the setup and outdoor computer installation was 
not waterproof, care was taken to protect it from even- 
tually upcoming rain if necessary (Figure IB). 

In greenhouse experiments, maximal growth was also 
observed at night and the overall growth patterns were 
similar to the patterns obtained in the climate chambers 
and in the field (Figure 8). Yet, under these conditions, 
secondary fluctuations of leaf RGR occurred at night 
with a phase length of two to three hours. 

Light intensity in the climate chamber was kept con- 
stant at around 580 ± 75 [imol PAR m'V 1 during the light 
period and it was completely dark during night (data not 
shown). In the field, global radiation increased continu- 
ously beginning at around 4 am and reached its peak at 
noon but then started again to decline towards dusk 
(Figure 7). At both measuring days, a temporary drop in 
global radiation before noon was observed in the field. In 
the greenhouse, a similar pattern as seen in the field oc- 
curred with a drop in global radiation in the middle of the 
morning (Figure 8). 

Relative humidity in the climate chamber was kept 
constant at 60% with no strong fluctuations during all 
four days (Figure 6). In the field, relative humidity was 
highest during night and decreased continuously during 
the day reaching its minimum value in mid-afternoon 
(Figure 7). In greenhouse experiments, relative humidity 
was kept constant at around 60%, comparable to climate 
chamber experiments (Figure 8). 

Temperature in the climate chamber was kept at 24°C 
during the light period and at 20°C during night 
(Figure 6). Temperature at the field site fluctuated more se- 
verely compared to greenhouse and climate chamber con- 
ditions, reaching a maximum in mid-afternoon (Figure 7). 
In greenhouse experiments temperature showed no strong 
fluctuations and was kept at roughly 22°C (Figure 8). 

Discussion 

Diel growth patterns 

Image analysis of soybean leaf growth based on the 
Martrack Leaf algorithm was shown to be robust under 
indoor and outdoor conditions. The basic pattern of diel 
leaf growth was comparable to patterns described be- 
fore, which were analyzed by optical flow based ap- 
proaches [65]. Based on the few data series acquired 
here, it is not possible to conclude on the statistical sig- 
nificance of the differences of the diel growth cycles 
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obtained under the different illumination conditions. 
The focus of the manuscript is to show that the method 
produces meaningful results even under very different 
illumination conditions. Nevertheless, it is important to 
point out that similarities and differences between treat- 
ments with respect to the resulting diel leaf growth 
cycles are physiologically reasonable. The observed mid- 
day leaf growth depression in the field, for example, 
might be a short-term stress reaction, which could have 
been linked to a general water vapor deficit, or to adap- 
tions in transpiration rates under full sun exposure. It is 
well-known that short-term alterations in turgor pres- 
sure lead to short-term growth peaks or troughs [17,30]. 
At this time of the day, also global irradiation decreased 
transiently, suggesting another possible reason for the 



deviation of leaf growth in the field from the smoother 
pattern observed in the climate chamber. This has to be 
investigated in more detail in future studies. In the 
greenhouse, growth rates were rather low and highest 
growth activity was observed during the night. Again, 
the overall diel growth pattern was comparable to the 
pattern described previously [65] and it did not show a 
direct relation to air temperature but seems to be rather 
dominated by endogenous control mechanisms. It is 
principally possible, that those differences are related to 
differences in leaf and plant age: Plants investigated in 
climate chamber, greenhouse and in the field experi- 
enced different environmental conditions throughout 
their entire development. Therefore, it was not possible 
to compare growth of leaves of identical plant 
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developmental stages. To date, there is no indication in 
literature, how severely differences in plant develop- 
ment might potentially affect diel leaf growth patterns. 

Comparison to other methods 

Martrack Leaf is more robust than optical flow based ap- 
proaches and provides higher experimental versatility 
compared to morphometric analyses or to mechanical 



analyses of leaf elongation growth - such as linear vari- 
able displacement transducer (LVDT) or rotary resist- 
ance transducer (RRT) approaches (Additional files 5 
and 6: Tables SI and S2). Compared to optical flow ana- 
lysis, marker tracking allows for larger movements of 
the tracked structures. Markers can be tracked in con- 
secutive images as long as they move less than the se- 
lected search length. To circumvent confounding of 
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Dial growth of soybean leaves in greenhouse 
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Figure 8 Diel growth pattern of soybean leaves in the greenhouse. (A, B, C) Relative growth rates (RGR) in % per hour of three soybean 
leaves for day 1-3 (A,B) and day 1 and 2 (C); (D) Global radiation (Whm-2); (E) relative humidity (%) and (F) temperature (°C) for corresponding 
days. 



different markers (beads) the search-length should be 
chosen smaller than the closest distance between two 
markers. 

In optical flow analysis, movement of structures must 
not exceed one pixel per frame. Martrack Leaf allows 
image analysis with fewer images acquired within 24 h 
to reveal basic diel leaf growth patterns compared to 
optical flow based procedures such as DISP. Moreover, 
wind-induced shifts of the leaf from one image to the 
next do not pose a severe problem to Martrack Leaf. 

Another reason, why optical flow based approaches do 
not provide high chances for successful leaf growth ana- 
lyses in the field is the requirement of the BCCE. Only 



under special circumstances, such as practically cloud- 
less days [17], image brightness changes are slow enough 
to provide constant brightness throughout a large stretch 
of the image sequence. To avoid brightness changes 
within image sequences, automatic adjustments to image 
brightness are typically used in industrial and consumer 
image acquisition. This can be realized for example by 
Automatic Gain Correction (AGC) which can be applied 
to either the complete image or to a selected region of an 
image or object. Yet for growth analysis based on grey 
value intensities, such as in the optical flow based DISP 
method, AGC usage causes additional problems and is 
thus typically avoided by using manually fixed set values: 
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In typical image sequences of growing leaves, brightness 
changes often occur heterogeneously for example in the 
form of shadows from neighboring leaves or technical 
structures that travel slowly through the image sequence 
or that increase in size. These brightness gradients can 
disturb the quality of an image sequence severely and they 
can lead to unwanted artifacts in the calculation of RGR. 
If these artifacts are corrected for automatically, the rela- 
tion between brightness of neighboring structures is 
shifted, which leads to the situation that those structures 
cannot be followed correctly. Biases can also be caused by 
changes in the reflectivity of the background: Soil for ex- 
ample normally shows a very low reflectivity in the near 
infrared part of the spectrum but its reflectivity increases 
with reduced water content. 

Optical flow based methods provide advantages with 
respect to the spatial differentiation of growth rates 
within the analyzed leaf and they often do not require 
application of marks to the leaf surface. It also has to be 
pointed out that brightness changes can lead to prob- 
lems also in marker tracking approaches since they also 
hamper marker recognition: Tracking of the marker 
structures in Martrack Leaf is based on block matching 
algorithms. Block matching algorithms are frequently 
used in motion estimation especially for video compres- 
sion [66-68] or other applications such as the evaluation 
of microscopic images [69]. As the block matching 
algorithm compares image patches, any change of the 
compared patches due to occurring or moving shadows 
lowers the accuracy of the position determination. This 
could be circumvented by a template matching algo- 
rithm which will be implemented in further work. Fur- 
thermore, the chosen template size and search length as 
well as the image resolution of the sequence can have an 
effect on the analysis by the algorithm. Thus, the tem- 
plate size should be chosen in a way that allows for the 
bead to fit inside the template, but the template size should 
not be selected markedly larger than the bead. The search 
length needs to be chosen in a way that the bead can be 
tracked during the whole sequence. Block matching algo- 
rithms could also be implemented in optical-flow based 
techniques, but this is cumbersome and would increase 
computing time and would not give any advantage as long, 
as the growth of whole organs is regarded. 

Issues related to storage and image processing times 

One typical difference in practical handling of the differ- 
ent methods used for diel leaf growth analysis is related 
to the amount of storage and processing and evaluation 
time necessary for calculations and long term backup. 
Typically RRTs provide the fewest problems in this re- 
spect. Acquired data stacks are very small, even if acqui- 
sition is performed in very high temporal resolution. In 
contrast the DISP method produces enormous stacks of 



data for every plant investigated. Image sequences of 
growing leaves acquired for DISP analysis over several 
days characteristically have a size of 1 to 2 GB depending 
on the selected image resolution, bit depth, time between 
frames and the overall duration of image acquisition. If 
higher temporal resolution is necessary (since leaves are 
otherwise growing too rapidly to fulfill the requirement of 
a maximal velocity of 1 pixel per frame), or if plants are 
monitored for many consecutive days, sequences can eas- 
ily excess sizes of 2 GB. Image sequences acquired for 
DISP are very big and their evaluation requires creating of 
several other files that contain the information on veloci- 
ties of all image pixels in x- and y-direction and on quality 
estimations. These additional files exceed the size of the 
original image sequences. Thus, overall size of image se- 
quences for each investigated plant/leaf typically lies in 
the range of 5 to 8 GB. An experimental design with sev- 
eral replicates under different environmental conditions 
or mutant lines easily can be in the range of 100 to 1000 
GB if standard camera resolutions (640 x 480 to 800 x 
600 pixels) are selected. 

Conclusion 

Robust tracking based methods such as Martrack Leaf 
will be beneficial for the further elucidation of genotype 
x environment x management interactions affecting leaf 
growth processes. Thereby, they will be able to play an 
important role both for the elucidation of processes con- 
trolling leaf growth and for an improved understanding 
of growth reaction to the variation of environmental pa- 
rameters alike. 
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